Papers with evidence detection
Improving Evidence Detection by Leveraging Warrants (D19-66)
Copied to clipboard
| Challenge: | Existing methods for extracting warrants from a corpus of arguments are lacking in argument detection. |
| Approach: | They propose to extract multiple warrants from an existing corpus of arguments and then aggregate them . they show that the method needs to be improved, but that it can still improve evidence detection. |
| Outcome: | The proposed method can improve the performance of evidence detection by analyzing arguments and aggregating them. |
DetectBench: Can Large Language Model Detect and Piece Together Implicit Evidence? (2024.findings-emnlp)
Copied to clipboard
Zhouhong Gu, Lin Zhang, Xiaoxuan Zhu, Jiangjie Chen, Wenhao Huang, Yikai Zhang, Shusen Wang, Zheyu Ye, Yan Gao, Hongwei Feng, Yanghua Xiao
| Challenge: | Existing LLMs' abilities to detect evidence in long contexts are far inferior to humans. |
| Approach: | They propose a benchmark to assess LLMs' abilities in evidence and multi-step commonsense reasoning within a long context. |
| Outcome: | The proposed method improves the performance of LLMs in evidence detection and commonsense reasoning. |
Cross-Domain Argument Quality Estimation (2023.findings-acl)
Copied to clipboard
| Challenge: | Argument mining is a field of automated discovery and organization of arguments. |
| Approach: | They propose to generalize argument quality estimation from multiple angles by combining empirical results with a training part. |
| Outcome: | The proposed method combines the results of two empirical evaluations with a training part to show that argument quality is among the more challenging tasks but can improve others. |